REFLECTANCE MAP TECHNIQUES FOR ANALYZINC SURFACE DEFECTS 
IN METAL CASTINCS 
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. INTRODUCTION 











:enes containing plane-faced polyhedre. Initially, tho 

purpose of inago analysis Mas to generate a two-dlnenslonal line drawing of 
the scene [Blnrord and Horn 71J. The purpose of scene analysis was to 
Interpret a two-dlnenslonal line drawing In terns of the tbree-dlnenslonal 
objects which gave rise to It [Roberts 61], [Gutnan 681, [Huftaan 71], 
[Clowes 71], [Itachworth 71), (Veils 7S], (Ulnston 7S). 

As the field natured, the actual distinction between Inage analysis 


Imago analysis and sci 
[Freuder 76], One bene 


lk 72). [Winston 73], 

. Sensitive line-finding procedures 















id correlation be 


significant 






1.3.5 IMACE ILLUMINATION CAUSES PROBLEMS 






I£4 SURFACE PHOTOMETRY CAUSES PROBLEMS 




LI* THE HUMAN VISUAL SYSTEM IS REMARKABLY FORCIVINC 
The human visual system does a remarkable Job of Interpreting 


Intensity despite problems caused by projection. Illumination and surface 



Importantly. Image analysis requlros good physical nodals of how surfaces 
reflect light. 


I.S INSPECTION IS A GOOD DOMAIN FOR IMACE ANALYSIS 


Then, however. the problem becomes one of developing an ablllity to 
eliminate the influence of prior expectation on visual Interpretation. 

















Materials waste by achieving tighter control over the 
Manufacturing process. Tighter control requires More 


Productivity In casting Inspection Is lo«. Ilalntalnlng 
tight duality standards Is a difficult and costly 


Tasks requiring 
Repetitive tasks 


induco borcdon. Vet inspection denands 
cal alertness. Autonation Is the key to 


Casting la a vital component of the netal uorklng 
Industry. The trend Is towards the increased Importance 



Foundries are lob-shop environments. The typical Toundry 
casts nany different part geometries In snail to Medium 


available for the automation of large volume production 


The pallatised, pick and 






flexibility 










It Is determines by the optical constants or the object ■atonal and by the 
surfnce microstructure. (Surface mlcrostructure Is surface detail mhlch Is 


i observable effects In 






Equation (1.5.11 relates those four factors. 










shiny. Regions In the first Inane appear dull uhlle the same regions In 
the second Image appear shiny, even though the Intensity values recorded 
nro identical. Equation (l.J.l) accounts only for the intensity values 




1.5.1 RELATED APPLICATIONS 

graphics, one problem Is the generation of gray-level images from surface 









1.6 SUMMARY OF THE REPORT 



topography. Incident 











imooe Hessian matrix Is used to represent surface curvature. Th« 
reflectance nap establishes the relationship between surface orlentetlon 










Information can be determined only whan additional information is provided, 







Illumination, then 




locally by the lntenelty values re 
exploited In a nev technique cells 

Chapter 4 provides a brief Introduction to the probleb of betel 
Tuo particular casting applications are presented. 


oas. Ibis chapter Is not critical to the technical 
> It serves as a general Introduction to casting 
on metallurgist and ns a background for the particular 

b three circle (Abrams) procedure defined in ASTO 
'4 ■Standard Methods for Estimating the Average Grain 
e program makes use of multiple edge mask filters to 


a magnifications and grain s: 


demonstrated ui 





synthesized 












d intensity depends upon 1 




2.1 A VIEWER-CENTERED REPRESENTATION FOR SHAPE 


the specific application. 









chosen distinguishes the following three classes or lunge feature: 
1* Points of range discontinuity (occlusion boundaries). 

*• Points of surface-orientation discontinuity 


[Harr 77b] calls this regrosontetlon the J-1/2-D sketch and argues for 
Its usefulness os an lntemedlate stage In a vision systea for dotorulnlng 









Interpreting Image Intensity 














point in tho other Image. Thus, storoo ranging surfers from the Sana 
qualitative imitations as does tho tachnlque or eutonetlc focussing. 
Solving the correspondence problem depends on tho presence or reetures in 

for ranging over objects with uniform surfeco cover and saoothly varying 





















Intensity 








Interpreting Inage Intensity 







Intensity 


Image formation [Horn 77J. This relation is established by stowing how 
image intensity is determined by the surface reflectance function d(l.o.g) 


Suppose that each surface element receives 
Illumination. Then, p(i.e.g) determines the 


constant incident 


orthographic projection, each p 

ctlon, the direction tc 




d(i.e.g). a function of throe variables, can be represented as a function 








Moto what has happened. The reflectance map captures the surrace 

surface and viewer geometry. The two assumptions necessary to write <Z.l) 


illumination 






Interpreting luge Intensity 






























Figure 2-4 The reTlecUnce nap Tor a laabortlan aurTlee lllinlnated by • 
single distant point source at gradient p, * 0,7 and q, B 0.3 with a • 1 
The reflectance nap Is plotted as a sorles of contours spaced 0.1 units 






certain surface elements can receive secondary Illumination due to light 
reflected from other sections of surface 11.e., mutual lllunlnatlon). 


14 RE-F.XAMININC PHYSICAL CONSTRAINTS 

One can fornulate the problem of determining the point m gradient 
spaco (p.q) corresponding to the Image Intensity point l(x.y) analytically. 
The rosult Is a nonlinear first-order partial differential aquation which 











p». 






Interpreting la 


Such methods hove been called cooperative algorithms 
[Harr h Poggio 76) or relaxation labolliog [Rosenfeld. Hummel 6 Zucker 76). 


boro Is to understand the physical basis for the local constraints used and 


2.S SPECIFYING LOCAL CONSTRAINT 




Tha essential physical constraint to be exploited is that surfaces 
vary smoothly almost everywhere. This surface smoothness assumption Is 


n Illustrate how phystcol 


additional constraint 











Interpreting 





lugs Intensity 



tet Is consistent with 
direction or steepest 






Intensity 
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for each (r.#) 1 • J.J.n-l 


BULE II: CHAHGES in PIRECTIOW OF STEEPEST DE5CEWT 













surface that are nonotonlcally nonincreasing In direction 


constrained si 


2.S HYPOTHESIZING MONOTONICITY RELATIONS 


explore all possible orderli 








Interpretation would propagate to neighboring sets of selected Inage point 



propagation of local constraint would converge to o correct globe 
Interpretation while -Incorrect- propagations would gulchly die out. 
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interpreting luge intensity 


e direction or steepest 



e particular luge 


eventually belong to 


constrained by the eppllcatlon 




iteratively 




Currently, the pr 



edge), OCCLUSION boundaries ere detected by noting when 
boundary points to existing patterns have e view angle 


pproachlng n/2). CONVEX or CONCAVE edges, on the other 




is discontinuities In surrace no 









Interpreting luge Intensity 


2.« AN ILLUSTRATIVE EXAMPLE 

Cnnsider the single example of s lonbertlnn sphere Illuminated by a 
single distent light snurce. The Intensity space to gradient space 
correspondence mill be derived analytically sod used to generate a 
synthetic luge. The algorithm mill be applied to the synthesised Image. 







lr K* ♦ y 2 » r* 











determined analytically, corresponding to tha sampled inage pointa. 
Flguro 2-9 redraws figure 2-8 Put with the gradient points corresponding to 









Interpreting Inage Intensity 



Figure 2*8 Tile gradient points, determined analytically, corresponding to 






Figure 2-9 The gradient point* of figure 2-0 which receive Ulualnallon fro* 
the light source (i.e.. the gradients with 1 « n/Z). 








ip progran hps dotarmlnad th 





Interpreting luge Intensity 



within gradient 
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pproxlnala rad 
direction of . 







Exploiting Additional Constraint 


>. EXPLOITING ADDITIONAL CONSTRAINT 



Horn has considered situations In which special properties or surroco 
photometry simplify luge analysis [Horn 75). (Horn 77). mis chapter 
presents a complementary study, amplifications due to special properties 
of surface photometry constrain the reflectance up. When viewed fron 


constant cos(i)/cos(e). mis 



topography. Here, an arbitrary reflectance up Is allowed. Instead, 
simplifications arise from known proportion of surface curvature. It Is 


surfaces with constant Imago 
and for surfaces corresponding 












Photometric stereo exploits tin additional constraint provided froo a 


direction of incident lllunlnallon. 


S.I SURFACES WITH CONSTANT IMACE HESSIAN 






coablne local evidence about the Hessian and determine it coapletely. 







satisfy the two differential equations: 


9f(».y) . » 
Jy 



(where It Is an arbitrary constant) satisfy the two differential equations. 




Typically, a sphere 1 








reflectance nap is the image of a paraboloid, but that, for such a surfac 


ldontity matrix. In general, In ordor to have a constant Hessian H, 
surface with explicit representation a a f(x,y> must have no terms 
higher than second order (in x end y). That Is. the surfeco can 





Exploiting Additional Constraint 
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(dp.dq] ■ (I a ,I v ]dt. Th 




"Strain the set of [dp.dq] that can con 












in range in gradient at 


illustrates t! 
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72 Exploiting Additional Constraint 


After applying those two Inequalities to each of the fo 
figure 3-1, the constrained contours of figure 3-2 are obtele 
There Is one additional constraint available. H del 
transformation. For the particular choice of Pi, Pj, Pj 
observe that the Cdx.dy] used to novo rrom (xo.yo) to Pi is I 
the [dx.dy] used to move from (xo.») to Pj. (Similarly, fi 
Thus the corresponding (dp.dql's must be the negative of ei 














Exploiting Additional Constraint 



1-1 Tho four rnfloctonco map contours 
Lho exact location, dotarmtnod analytically, i 


possible gradients 
Ps and Pa. Crossos 









it surtaci undor consideration li 




Constraint 





1-3 Tils restricted subsection of contour for Pi, P 7 p, and p 4 






Exploiting Additional Constraint 



Figure !-i The fe»lly of olllptti 
renalnlno In the^determination thesis 


characterize the uncertainty 
’ of constant Intensity in the 




Exploiting Additional Constraint 





inaga Haitian 









Exploiting Additional Constraint 




As before. I. and I, denote tho first partial derivatives of I(x.y) at 


R(p.g) at the corresponding gradient point (po.qo). 

Thus, given any initial lnoga point (xo.yo) Knovn to correspond 




[dp.dflj* ■ H [dx,dy] T (3.Z.4) 


Horn's original netnod for obtaining shape fron shading information 











Exploiting Additional Constraint 





Exploiting Additional Constraint 







Exploiting Additional Constraint 




determining surface topography by analyzing tha Intensity variation across 
smooth suctions of object surraco and nothods for dotaralolng object shape 
by analyzing tha occluding contours present in an loego. 

This section is preliminary. The question ashed is. ’If the object is 
a generalized cono. then hou does this constrain tbo Intensity valuos 
recorded in an lnage of the object?” The question one really wants to ask 








magnifying or contracting 












parametrically by: 


h’(y) daaotaa the ds 




it generalized cone with circular 


Flame, the value of h'(M can always be determined directly 

ed in figure 1-7. Differing values of -h*(y) Introduce a 
factor In q. Thus, finding the point (po.qo) In gradient 
sponding to an Image Intensity point l(n.m) > o simplifies to 
ISS. First, for the particular value of yo. determine 



Exploiting Additional 



so that tho dorlvatlva of tha axial scaling function MX) Is glvon by: 


tilting objoct 





Exploiting Additional Constraint 




Exploiting Additional 







Exploiting Additional Constraint 









cos(*)[cos(3) - si 


cos(*)[cos(«) - si 








This loads to too difficulties. First, vtthout mooing «. the curve In 


gradient space generated by (3.3.3) and (3.3.4) cannot be determined. 
Second, -Ithout knotting d. the Intonslty profile in the imago corresponding 









Exploiting Additional Constrnlnt 








simplification 



Exploiting Additional Constraint 









Exploiting Additional 


i information r 


[sln(-#i) • sln(fa)) 


1 .4 PHOTOMETRIC STEREO 


Traditional si 


calculated by trlangulatlon. 


is difficult to dotomlno 
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ing Additional Constraint 




tho light source placed et gradient point (ps.qn). Call the corresponding 
reflectance nap Rs(p.q). A third image Islx.y) is obtained ahlch satisfies 


ip(«.yl • KllP.g) 


>i(».y) ■ Ri(p.g) 


la(a.y) • RolP.ql 


>r by rotating the object surface ar 




sourco. The equivalent of photometric stereo can also be achieved in a 
single view by using nultlple illuminations which can be separated by 




Exploiting Additional 


Photometric si 


it characterizing o< 


in corresponding gradient (p.g). 
a general technlqua for deterolnlng 


points Is often sufficient to deternine the position and orientation of a 

A particularly useful special case concerns object points whose 
surface normal directly faces the vlewor il.o. object points with p » 0 and 


Incident Illumination about the 




located without explicitly determining the reflectance map 






a illustrated u 







tho Inage point {».»). If U 


in plots. In gradient 


)0 laages are obtained 





Exploiting Additional Constraint 



Figure 5-10 Datonilnlng tho surraco orientation at a given imago point 
(x.y). Three superimposed reflectance map contours are intersected uhoro 
each contour corresponds to an Intensity value at (x.y) obtained from threo 
separate Images, taten under the sane lnaglno geometry but ulth different 
light source position. 





Exploiting Addltlonol Constraint 


3.4.2 DETERMINING OBJECT POINTS WITH CIVEN SURFACE ORIENTATION 



spaca, thi throo contours Mx.y) . <I|, lilx.y) • o, and Is(x.y) ■ o 3 . 












lntorsact deternlnss an i 




, Ri(p.d) • Rilp.d) • 





Exploiting Additional Constraint 


US USING PHOTOMETRIC STEREO 





Exploiting Additional Constraint 









Exploiting Additional 







Exploiting Additional 



Figure J-1J Applying photometric stereo to^ four^^imttnplindi p ®' nt " 
nark tho gradients determined it each sampled Image point. (Compare tills 
figure Kith the single Imago result of Figure 2-10.) 





Exploiting Mdltiooil Constraint 









it difficulties night on 




quite tolerant of errors for image points uhose corresponding gradient lies 
in the third quadrant of gradient space. On the other hand, slight errors 
in tho measureaent of intensity for image points uhose gradient lies in the 

determined for that gradient. Figure 3-16 repeats figure 3-15 hot for the 




reflectance 



Exploiting Additional 










Exploiting Additional Constraint 










Casting Applications 


4. TWO CASTING APPLICATIONS 

In order to understand the Inspection requirements of the casting industry. 




foundry for the development of precision, Investment-east turbine blades 
nnd vanes for aircraft Jet engines. The socond was a large, batch-orlentod 




particular inspection ta 



control of mechanical properties. The process is adaptable to alaiost any 



Casting Applications 















Individual layers. Moisture removal Is regulated by control of Met and dry 






Casting Applications 


tho aold is achieved by kiln hardening. 

Host hlgb-teaperature soperalloys era Ballad using a vacuun-lnductlon 
furnaca. Vacuua salting roducos tho anount of dissolved gases In tho 


through volatilisation of existing lmpurltlos. Vacuua Belting reduces tho 
nUBbor of resulting Inclusions In the casting and thus laproves the 


Into pouring position. When the specified pouring teaperature has been 


reached, the Betal Is poured Into the Bold at a controlled rate. The Bold 


then opened to allow reaoval of the filled 


After solidification. 


blasting. A first visual Inspection Is 





















Casting Applications 





4.2 GREEN SAND MOLD CASTING 

Green send molding is the nost versatile end inexpensive casting 

production volunes. At the particular foundry visited, approxlaetely 40X 
of the castings produced were to neot the Internal nanufacturing demands of 



destructive test facilities are available to ellnlnete systematic design 


h application, \ 







id Modified froM 


















Casting Applications 






























uniformly. Rejection n 









Casting Applications 





the interface 













S. CRAIN SIZE ESTIMATION 








castings. The turbine 


be sufficiently large. 

net have a preferred orientation. 


solidification naturally occurs out from the leading and trailing edges of 



Irable. The coarseness of porosity Is proportional to grain size, 
sequently, porosity is finer and less harmful In fine grain aluminum 


tings. Also, certain mechanical properties, such es tensile strength. 

usually superior for fine grain aluminum castings. Finally, for 
mlnun alloys, fine grain minimizes shrinkage, causing castings to bo 




ESTIMATING THE A VERACE CHAIN SIZE OF METALS 






Estimation 


Comparison procedures ar. considered convenient for 
n inspectors end sufficiently eccurete for oost 





Included completely within th 


the area gives the number of equivalent whole grains. 




Planlmetrlc procedures are more accurate than comparison 
procedures. Accuracy rails rapidly, however, when grain 

Intercept Procedures: 


Intercept procedures Involve counting the nuaher of 




si 





s specified In section 11 




perforaence end nccurecy celled for by t 
First, tte Abreas procedure Is outlined a 

















resulting 







Estimation 


statistically con-act Asm grain number Tor saaplss In the recommended 
working range. The program was tested end calibrated oslng sample plates 
available from the American Socioty for Testing and Aaterlals as an adjunct 





5 5 A PROCRAM FOR DETERMINING ASTM CRAIN NUMBER 


The initial discussion presented hero .focuses on the problem of 
applying the three circle (Abrams) procedure to ioages of a planar surface 




twofold. First, the applicable 


additional 


The program discussed mates use 


foreshortening ol 









array. TYPE Is HAXIHUH or H1HIHUH. INDEX Is tho 






Estimation 


4. SYNTACTIC ANALYSIS: 


syntactic parser. Basically, tha Job or tha parser is to look at each 
extremum In L and decide whether It corresponds to an actual grain 


h forward and backward fr 


d FILTERS arrays. 







automatically using an 












Figure 5-1 illustrates edge nask preprocessing applied to a single 
Idealized grain crossing. Figure S-l(a) shoos the intensity profile 


corresponding to a step in intensity. Figure 5-l(b). Figure 5-l(c) and 






r profiles corresponding t 















Figure 5-3 Illustrates the superior noise Infinity shot con bo 




Incroosod to 1.5b, -her. b Is egein tbe height of tbo original stop In 
Intonslly. Figure 5-3<b). Figure S-l(c) and Figure 5-3(d) show, 
respectively, the Filter proFiles coeputed using the sane choices For mi, 




there is a peat In the FUTERI array 
step In intensity. This peat, however. 


From the other peats due to noise Found in F1LTER1. 




le reliably rejected. 


Figure 5-3. The nest two Flgurot 
Is necessary to resolve closely 


spaced edges. Figure 5-4 Illustrates an ldaallaed example corresponding to 


two closely spaced grain crossings such that the step In intensity across 
oach boundary has the sane sign. Figure 5-4(n) shows the intensity 


respectively, 1 
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In Urn FILTER2 and FILTER! prt 






Thn computation of 01 














in Size Estimation 


MW 
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L— 













and type of each local extreeua In the corresponding FlLTERn. In fact, one 



to tho original arrays as required. A 









Grain Size Estlaation 


a peak Is accepted by one of the Individual 
responsibility of that routine to position the 


Input pointer correctly 


accepted as part of the edge. Parsing Is coeplete when there are no none 




The slaplest exanple of a parsing rot 

those Illustrated In figure 5-1 through f 


Individual parsing routines. Is passed the four argunents: 1 . 11 , 1 Z and 


type ruxinun r run L and 




the Indices in FILTEA1. FILTER? and 


(Z) Fi(11/BI, Fz(l)/K and Falll/eo have 'about the sane 








The above purling routine 5TEP-UP, together with a Holierly defined 


to apply the three circle (Abrams) procedure to alloy specimens that can bo 




a appropriate! 




each grain is not affected. Rather, the boundaries themselves are etched. 
Regions within the confines of a grain boundary are unaffected while the 


Testing and Raterlals 





Estimation 



rlglnal 
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ik of type luxinun oc 


Id FILTERS or tho pook 


• «i) or V. - (THRESHOLD ■ 


>0 -(THRESHOLD • mi) or 
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(I-)'Bin(w,m ). F?(l-)/mln(w,m?l an 

' Sana global threshold referred tc 


I trolling edges, otherwise, a 




igh, compared to the va 


t the doublet ca 


m,, then the expected heigh 

like two separate opposite a 

ogether with e similarly defln 








routines PULSE-UP and PULSE-DOWN give tl 
resolve closely spaced Intensity steps li 


the corrected three ellipses. Crosses narked along the three circles 

the middle circle of figure 5-8(a). 

corresponds to angular position (0 to 2n radians) along the test circle. 
The first graph shoos the Intensity vsluos obtained ulth the vidlcon 


for reference purposes, the 
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FOOTNOTE TO CHAPTER S: 




Relating Reflectance and 




[Hnrgan 53], [Jenkins 








sample Involves the determination of tho spatial and spectral distribution 
of the reflected radiation with rospect to both Intensity end state of 


analytic chemistry. The dependence of tho reflecting power of optically 











e the Intensity reflected 


Into the hemisphere defined by a < n/Z. Let li 




Relating Reflectance 




angle e. The surface reflectance function *(l,e,g) la defined by: 


:o figure 2-1). Such rt 



Another net hod for determining a reflectance nap la to uae a 


explicitly 
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• DETECTOR TECHNOLOGY, 






bo the subsequent angle of rototlo 

it followed by I, 













Relating Reflectance and 






Relating Reflectance 
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Relating Reflectance 






Relating Reflectance 
















Flgurt i 





Figure 6-8 Synthesized luege of shuttle eye using neesured terreln 







additional ossunplloni about tho nature of the 


conputlng object roller fro. Hugo Intensity. The loago Haitian has boon 
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A.S THE IMACE HESSIAN MATRIX 

In this work, ths retirement that [dx.dy] hs chosen In n particular 
direction la relaxed. The reason Is not to sake the problem more 


[dp,dq]'s that 




















Hatheaatlcal Details 



Figure A t Ilia 







Rathematical Details 


gradient points corresponding to lnaoe point (xo.yo). 

The second Inequality helps to constrain the » 
apace [dp.dq] that can correspond to a movement [dx 
Suppose Image point (xo.yo) la known to correspond to 
(po.qo). The vector (dx.dy] defines the direction ol 
space (figure A-3(a)). Now. dxdp » dydq > 1 lr and 
between [dx.dy] and the corresponding [dp.dq] is less tl 




if Increasing view angle. 
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Hatheoatlcal Details 



f <«0 4dl '->’0* d ‘' 1 ^ 
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dpdx ♦ dqdy=0 


Figure A-J The Inequality dpdx ♦ 






Natheoatical Details 











hathematical Details 



(xg*dx.yg*dy) XAVyA' 

'“o-fo 1 . 'V\V\VV' 

y <P0' < ’0* 


ypdx*dqdy=0 



Figure A t Surface convexity can be used to choose a uoveoent [dx.dyj In the 
Image such^ that the corresponding movement [dp,do] in gradient space 






[dp.dqr = H [dx.dyr 


„.*-i^5Fny 
», ■ f . iff+r * 














natheoatlcal Details 



Figure AC KulUpllcatlon b 
















nathenatical Details 


1 calculus. Rather, the analytic r 
developed hors can Da used to Illustrate the connection betu 
viewer-centered definition of the Inaoo Hosslan netrlx H and tlu 
Id definition of curvature. 


there Is described Implicitly by th 
f(x.y.a) . s' • y> . - r* • • 




y dlfferentletlng 
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Mathematical Details 



Tlirorem A 10 Let a a f(x.y) bo the equation describing a 
smooth surface. Let dl be the differential of the arc on 


■ IDx.dyll* = 7ldx.dylACdx.dyr 


Interpret nullipltcatioo I 

gradient (p.ql. Finding tl 






surface corresponding to a given curve in the lnaga depends on both th 
magnitude and angular position of the gradient at aach Image point on th 
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Cataloging Casting Defects 


skin on the surface of the casting. It arises "hen the sold surface 



Excessive lubrication 




